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During fall 1972, Bronx Community College inaugurated 
Project STIE, an interdisciplinary, block-programmed project designed 
to facilitate an intense, collaborative remediation program for 
entering Liberal Arts freshmen needing remedial assistance in 
reading, writing, and mathematics. This project was later renamed 
Project LINK, and was expanded to offer special courses for 
pre-nursing and evening students and to allow the enrollment of more 
Liberal Artp students. It was also expanded to include a 
full- semester orientation seminar for student counseling. This report 
presents the final assessment of the program. Eesults indicate that 
the program did little to reduce attrition, to improve achievement 
motivation or allied ego functions, or to improve writing, or math 
ability. It was successful in improving reading competency. Methods 
of program evaluatio^i are described^ and faculty perceptions of the 
benefits and drawbacks of the program are noted. (DC) 
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CHAPTER I 
BACKGROUND AND INTRODUCTION 



During the Fall 1972 semester, Bronx Community College 
inaugurated Project STIR, an inter-disciplinary, block-programmed project 
designed to facilitate an intense, collaborative remediation program for 
those entering Liberal Arts freshmen who needed remedial assistance in 
reading, writing and mathemtitics. Accordingly, the original STIR faculty 
consisted of one member from each of the three remedial subject areas 
plus an instructor in health (a credit-bearing college-level course) and 
one counselor. The Fall 1972 STIR program enrolled 38 day students; 
the ^ring 1973 continuation, with the same facxxlty members, enrolled 30 
day students. During the 1972-73 academic year, STIR faculty met as a 
project group at least once a week, cn a regularly scheduled basis. 

Since Project STIR was in essence a pilot program, project 
goals were stated rather globally by the faculty as follows: 1) integration of 
instructional efforts; 2) reinforcement of the philosophy of a humanistic 
approach to teaching; 3) on-going evaluation to assess progress; 4)sooial- 
izing, both intra- and inter- staff and students; and 5) others, to come 
from the working group. These five goals formed the basis of a narrative 
report submitted by the project faculty involved. 
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A subsequent report in May 1973 by the Office of Institutional 
Research concerned itself with objective student output variables such as 
course registration, grades earned, pre- and poBtte it scores where 
available and retention rates, all in the Fall 1972 STIR group. Each 
academic subject component of the STIR program was analyzed separately 
and program-wide trends and preliminary conclusions were delineated* 
Through-out, data from two separate comparison groups were obtained: 

1) Studencs eli^.ble for STIR who expressed interest 
in the program aF a result of a recruitment letter 
but v/ho, for a ^ ariety of predominantly personal 
reasons (i.e. job conflicts etc.), did not enroll in 
STIR. Thi& comparison group consisted of the 
same 33 students for all four academic subjects 
and will be referred to as '^STER eligible, non- 
takers". 

2) Students in other class sections of the same 
course, during the same Fall 1972 semester who 
were taught by the same Instructor as the STIR 
group. Although this comparison group was 
formed 1^: the same manner for the four academic 
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subjects, the specific membership of each group 
varied as the college does not regularly operate 
in a block-programmed format. This group 
will be referred to for each academic sub- 
ject as "Non-STIR, same instructor". 
By specific academic subject areas, a variety of conclusions 
were reached for the pilot project. They will be enumerated here as tiiese 
conclusions, in part, reveal the basis for Project STIR'S expansion. The 
expanded version was renamed Project LINK, and is the subject of the body 
of this evaluative report. 

Fall 1972 STIR Findings 



Reading . At the level of actual registration for the remedial reading course, 
designated RDL 02 for the entire college, a substantial difference was noted 
in favor of the STER program. All STIR students were enrolled in RDL 02; 
by contrast, fully 50% of the STIR eligible, non-takers group were not en- 
rolled in RDL 02 during the Fall 1972 semester, even though placement tests 
Indicated RDL 02 was required. There seems to be a strong implication that 
the STIR block-program format seems to overcome some of the hazards 
inherent in a large traditional college registration procedure. 
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At the level of subject-matter mastery, the Department of 
Special Education Services routinely administers tiie Nelson-Denny Reading 
Test, Form A (Houghton, Mifflin Co. ) to all incoming freshmen as a 
placement test. This department is responsible for all remedial reading 
courses; a raw score of 60 (corresponding to a grade-equivalent score of 
11.4) has been established as the cut-off score below which RDL 02 is 
required. Form B of the Nelson-Denny is administered to those students 
for whom RDL 02 is required as an end-of-semester posttest. For these 
students, scores on Form A function as pretest scores. The department 
also administers a Departmental Final Mastery Test which emphasizes 
study skills as a second posttest measure. 

A variety of statistical analyses, including an analysis of 
covariance cm the Nelson-Denny posttest scores with the pretest scores as 
the covariate, found no evidence for differences in either direction between 
the STIR students and the comparison group of Non-STIR students taught 
by the same RDL 02 instructor. This result was not especially surprising 
as STIR embodied no new curricula or materials. 

A product-moment correlation coefficient of . 72 was 
obtained L^etween the two posttest measures for the two groups pooled. 
Continued aininistration of both posttosts seemed warranted in light of the 
.49 shared or common variance of the two measures and the concomittant 
. 51 imique variance. 
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English* The only data available for the ENG 01 component of STIR was 
an analysis of ENG 01 grades eame'^ by STiR students and by the STIR 
eligible, non-takers group. Unfortunately, grading practices are some- 
what instructor-idiosyncratic. Fully 83% of the STIR students finishing 
the program received a grade of B for the ENG 01 course from the 
instructor, making comparisons somewhat problematic. No one received 
a grade of A, C or D. 

By comparison, records indicated that only 18% of the 33 
STIR eligible, non -takers group (6 students) received letter grades in 
ENG 01, in this case B's and C's. Another 15% received a grade of R 
(repeat) or F (&ilure), 6% recei\^ed a graae of J (withdrawal) and 0% 
were enrolled in ENG 13 (college-level freshman English), even though 
they were required to take ENG 01 on the basis of a placement writing 
sample. The remaining 56% (20 students) of the comparison group were 
not enrolled in ENG 01 during the Fall 1972 semester, a finding analogous 
to that discussed in the preceding section under RDL 02. Again, all 
STIR students were at least registered for ENG 01; only 44% of the com- 
parison group were no enrclled^ In spite of placement results indicating 
its necessity tor thef^e students. 
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The grade-related difficulties in program assessment are 
fairly obvious; grading practices are not uniform from instructor to 
instructor nor from academic subject to academic subject. Evaluative 
conclusions mus^ of necessity, be cautious where grades form the data 
base. The homogeneous grades earned by the STIR students underlined 
this difficulty, and accordingly, procedures to evaluate the English 
(writing) componeni; of further pr.^.ams have stressed the necessity 
for measurements obtained on a more objective basis. 

Mathematics. Again, only course registration in the first remedial 
mathematics course, designated MTH 05, and final grades therein were 
available as evaluative indicia for Project STIR. At the level of actual 
registration for MTH 05, there is, again, a substantial difference in favor 
of STIR. All STIR students were enrolled in MTH 05; by contrast, only 
52% of the STIR eligible, non-takers comparison group were enrolled in 
MTH 05, even though placement tests indicated its necessity. 

A comparison of grades awarded also seems to indicate 
a difference in favor of Project STIR: 58% of STIR students achieved 
passing letter grades from A to D, inclusive, as compared to 49% of 
the students in the Non-STIR, same instructor comparison group and 
12% of the students in the STIR eligible non-takers comparisoQ group. 
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The reasons for the difference, especially between the first two pro- 
portions cited above* are unclear. (48% of thie last group were not 
enrolled in MTH 05; of the 16 students who were enrolled, only 25% 
passed the course with a grade from A-D, inclusive.) 

Again, procedures to assess student progress in the 
mathematics component of further programs have stressed the necessity 
for measiirements obtained on a more objective basis. 

HeaJth. HLT 91 (Critical Issues in Health) was the sole credit course 
that Project STIR students were enrolled in. At the level of course 
registration there was, again, a substantial difference in favor of Project 
STIR. All STIR students were enrolled in HLT 91; by contrast, only 27% 
of the STIR eligible, non-takers comparison grou^, was enrolled in HLT 91. 

Program-Wide Trends. 

a) Registration; During the Fall 1972 semester 
55% of the 33 STIR eligible, non -takers comparison 
group were not registered in RDL 02; 56% were not 
registered In ENG 01 and 48% were not enrolled in 
MTH 05. All three remedial courses were required 
for these students. By comparison, all STIR 
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students were enrolled in all three courses* 
As mentioned, these records suggest tiiat the 
block-programmed format may be useful in 
overcoming some of the obstacles surround- 
ing traditional registration procedures in a 
large college, 
b) Retentio n; According to faculty records, 
42 students registered for Project SI IR in 
Jime 19?2 and 38 students actually speared in 
September 1372; 36 of these students finished 
the semester in January 1973, yielding a 
retention rate for the semester of 94%, a 
figure far in excess of any expectations* 

Note: In fairness, it should be mentioned that Project STIR 
classes were in session between noon and 5:00 p.m. Students unable to 
commit this block of time were not registered for the program. Both 
comparative registration and retention data are undoubtedly affected by 
this factor. 
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Project LINK 

The block-programmed format of Project STIR was expanded 
into the now renamed Project LINK in September 1973, LINK, as such, is 
thus an outgrowth of the interfaces between student needs, Project STIR 
evaluative data and continued program and curriculum development and 
implementation in 'the Office of the Dean of Academic Affairs. 

The four faculty members which comprised the original 2 
blocks of Project STIR (each of which contained a "family" of approximately 
15 students) continued into Project LINK with but a change in counselor. 
During the Fall 1973 semester these 2 blocks were referred to as STIR/LINK; 
the students in these 2 blocks were, as befort.. Liberal Arts entering 
freshmen with remedial placements in reading, writing and mathematics. 
During the Fall 1973 semester there were an additional 3 blocks of Liberal 
Arts students, 2 blocks of Pre-Nursing students and 1 block of Evening 
students. Again, all students were entering freshmen with remedial place- 
ments in all three academic subjects. 

The 8 blocks comprising Project LINK during the Fall 1973 
semester started in September with a total of 123 students, 46 males and 
77 females. All students in the 8 blocks took remedial reading (either RDL 01 
or RDL 02) and remedial writing (ENG 01). All students In the 2 Pre-Nursing 
blocks took a remedial mathematics course open only to pre-nursing students 
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(MTH 08); students in most of the Liberal Arts blocks took the regular first 
remedial matnemat:cs course (MTH 05); there v re some Liberal Arts 
blocks where students took no mathematiCL . .oe. Additionally, all 
st^^dents in the 8 blocks took Critical Issues in Health (HLT 91), the credit - 
bearing college-level course. 

As mentioned in the narrative section of the original grant 
proposal, all LINK students were enrolled for the regular six-session 
orientation workshop/seminar (SPD 99) offered by the Department of 
Student Development to all entering freshmen at the college. Additionally, 
SPD 99 was extended through-out the semester for all LINK students. 
The results of tests administered under the provisions of this grant for 
the purposes of either guidance and coimseling or program evaluation were 
used at the individual counselor's discretion, usually in supplementary 
individual counseling sessions. 

During the Spring 1974 semester. Project LINK was 
composed of 5 blocks; 4 blocks were Liberal Arts and 1 was a Pre-Nursing 
block. There were a total of 68 new LINK students at the start of the 
Spring 1974 semester, 29 males and 39 females. As during the Fall 1973 
semester, all students took rmedial reading (either RDL 01 or RDL 02) 
and remedial writing (ENG 01). Again all Pre-Nursing students took MTH 08 
and most of the Liberal Arts blocks took MTH 05. Again, all students were 
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enrolled in HLT 91 and SPD 99 for the entire semester. The original 
STIR faculty did not persist as an intact unit into the Spring 1974 
semester. 

During both the Fall and Spring semesters, a series 
of workshops were held for LINK coimselors, academic faculty, 
administrators and :Jie evaluation team. Although attendance was 
somewhat less than optimal, a substantial surfacing of both problems 
and advantages occurred. 

As mentioned in the original grant proposal, the 
program objectives, listed in order of estimated liklihood of positive 
effects, were: 

1. Reduced attrition 

2. Improvement in specified dimensions of 
i 3rsonality 

3. Improvement in basic skills 

4. Improvea achievement in regular community 
college courses 

The precise methodology and procedures followed for 

Pro^ ^t LINK program assessment follow separately in the next chapter 
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CHAPTER II 
DESIGN AND PROCEDURE 



For the purpose of program evaluation, a variety of 
instnunents assessing both scholastic aptitude and subject-matter 
achievement on the part of the students were administered in a pre- 
and posttest format to both Fall 1973 and Spring 1974 LINK groups. 
In all cases the instruments were administered as group tests. 
Additionally, a vocational interest inventory was administered once 
to each LINK group for guidance and counseling purposes. As 
mentioned earlier, individual results of the instruments used for 
program evaluation purposes were also made available to counselors 
on request by the Office of Institutional Research. 

During the Fall 1973 semester the evaluation instrun^-^-^s 
were administered by either the counselors (scholastic aptitude, math- 
ematics achievement) or the academic faculty (writing sample, reading 
achieve ment). The Fall faculty workshop surfaced some negative 
feelings of instrument-interference in the counselor-counselee relation- 
ship and, therefore, the Office of Institutional Research administered 
the scholastic aptitude instrument to all blocks and the mathematics 
achievement tests to some blocks during the Spring 1974 semester. 
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The appropriate academic faculty continued administration of the writing 
sample and reading achievement tests during the Spring semester; some 
mathematics faculty agreed to administer the Spring mathematics achieve- 
ment test. Counselors administered the vocational interest Inventory for 
both Fall and Spring LINK groups. In all cases, Spring and Fall, the 
OffJce of Institutional Research was available for make-ups of any missed 
instruments whatsoever. 

For clarity, a calendar of the data collection schedule 

follows: 



Fall 1973 LINK 

September (Pretests) 
Writing Sample 
Nelscn-Dennyf Form 

Educational Skills Test, Form A: Mathematics^ 
Differential Aptitude Test, Form I : Verbal Reasoning and 
Numerical Ability Subtests^ 

November ^ 
Kuder DD 

December (Posttests) 
Writing Sample 
Nelson-Denny, Form 

Educational Skills Test, Form A: Mathematics^ 
Differential Aptitude Test, Form M: Verbal Reasoning and 
Numerical Ability Subt^sts^ 
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^Nelson, M.J., Denny, E.i . and Brown, J.i., Nelson-Denny Reading 
Test. Boston: Houghton, Mlftiui Co. 

2 

Educational Skills Test/CoUege Edition: Mathematics, Monterey : 
California Test Bureau /Mc Graw -HiU , 197U 

^i3ennett, G.K, Seashore, H.G., and Wesman, A,G. , Differential 
Aptitude Tests. New York: Psychological Corporation, 1947, 1961. 
4 

Kuder, F. G. , Kuder form DD-Occupat!onal Interest Survey . Chicago: 
Science Resear^:*' w?sociates, 1964. 

9^ 16 
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Spring 1974 LINK 

F ebruary (Pretests) 

Same as September, (see prior page) 

April 

Same as November, (see prior page) 
May (Posttests) 

Same as December, (see prior page) 

The LINK groups for both Fall 1973 and Spring 1974 were 
described in detail in the preceding introductory chapter. The specific 
tests and procedures followed are described in the remainder of this 
chapter. 

Measures 

Writing Achievement. All English faculty in Project LINK obtained writing 
samples from their students during the first two weeks of class. The 
choice of topic was left to the student and a time limit of 20 minutes was 
imposed. Papers were then sent by section to the Office of Institutional 
Research where each paper was marked with a blue star; sections were re- 
assembled, and the papers were locked in a file cabinet. During the last 
two weeks of class the identical procedure was repeated; the papers were 
again sent to the Office of Institutional Research. This time the papers were 
each marked with a red star, and sections were re-assembled. At this 
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point, blue stars (pretests) and red ctars (posttests) were combined for 
each section and a random re-assignment of each section's pre- and 
posttests was made to another English faculty member teaching in 
LINIC. A cover letter was drafted (see Appendix A) wherein each 
English faculty person was asked to numerically rate each paper on 
an uncurved scale of 1 to 9. The faculty grader was unaware of the 
color coding scheme and did not grade his/her own students' papers. 
Moreover, the pre- and posttest for each student were rated by the 
same faculty grader. The intent of the procedure just described was 
the minimization of those variables which are commonly associated 
with a lack of internal validity. Procedures were identical for the 
8 Fall 1973 LINK blocks and the 5 Spring 1974 LINK blocks, all of 
whom contained an ENG 01 coir^ponent. 

Reading Achievement. All entering freshmen at the college take the 
Nelson-Denny Reading Test, Form A as a placement examination. As 
mentioned in the ir^troductory chapter, a raw score of 60 (grade- 
equivalent score = 11.4) is nresently the operative cut-off point. During 
the Fall semester RDL 02 students were roughly grouped into two 
categories: 
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a) low group (raw score below 40; grade equivalent score less than 9.0) 
and b) higher group (raw score trom 40-59; grade equivalent score 
between 9* 0 and 11. 4). Beginning with the Spring semester, the 
D8])artment of Special Educational Services lengthened the remedial read- 
ing program to two courses, where necessary: RDL 01 (raw score 
below 40) and RDL 02 (raw score from 40-59). This curriculum change 
went through the regular College Curriculum Committee procedures. 

Both RDL groups cited above were included in Project 
L[NK; departmental posttest procedures are presently the same for 
both groups. The Nelson-Denny Reading Test, Form B and a Depart- 
mental Final Mastery Test are routinely administered by the department 
to assess end-of^semester student competency. 

The Nelson-Denny includes two subtests. Vocabulary and 
Comprehension. Raw scores for these subtests are added together to 
get a total raw score, an indicia of reading competency. This total raw 
score was used in all data analyses. The Departmental Final Mastery 
Test emphasizes various study skills such as dictionary usuage, context 
clues, main ideas, outlining etc. and also yields a total raw score. 

No reliability or validity information could be found for 
the Nelson-Denny. Similarly, no such information has yet been developed 
for the Departmental Final Mastery Test. Within these limitations, 
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the departmental assessment procedures were considered lo be acceptable 
for LINK program evaluation purposes. 

Mathematics Achievement, At the present time, mathematics placenents 
at the college are accomplished by means of a student-mathematics 
instructor interview and an appraisal of high school mathematics 
preparation. The entering student is then placed either into a credit- 
beaming course, which may vary according to the students selected 
curriculimi and his/her high school preparation and achie^^ement, or into 
one of three remedial mathematics courses. For Pre-Nursing students, 
this remedial mathematics course is designated MTH 08; the course 
concentrates on the four basic arithmetic operations and concepts such 
as decimals ♦ fractions and percentages. All other students requiring 
mathematics remediation are enrolled in either MTH 05 or MTH 06. 
MTH 05 concentrates on arithmetic re\!ew, elementary algebra and 
some compTitational geometry. MTH 06 encompasses intermeiiate 
algebra and some basic eloments of trigonometry. MTH 05 usually has 
approximately double the course enrollment of MTH 06. 

Project LINK included sections of MTH 08 for the blocks 
of Pre-Nursing studems; there were 2 s'ich sections during Fall 1973 
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and 1 such section Spring 1974. The Liberal Arts blocks, 5 in the FaU 
and 4 in the Spring, usually included a MTH 05 course, but not always. 

There was no mathematics course included in the Fall Evening block. 

Additionally, there was no MTH 06 included in either semester / 

Project LINK. 

Since the department used no standardized instruments 
to assess student progress, the Educational Skills Test/College Edition: 
Mathematics (McGraw, Hill and Co.) {EST: Mathematics) was selected 
for evaluation and monitoring purposes. This instrument was admin- 
istered in a pre- and posttest format to all MTH 08 and MTH 05 students 
both Fall and Spring. Counselors administered the test during the Fall 
semester; as mentioned^the Office of Institutional Research administered 
it during the Spring semester, although some mathematics faculty agreed 
to give it to their sections, also Spring semester. During the Fall 
semester, counselors also administered the EST: Mathematics to 
students in LINK not^ enrolled in any mathematics course. The research 
design used here was intended to make possible comparisons between 
MTH 08, MTH 05 and MTH 00 (no mathematics) groups. 

The EST: Mathematics was specifically selected because, 
according to the Examiner's Manual^ "EST was designed to meet the 

^ Educational Skills Test/College Edition: Mathematics, Examiner's Manual . 
Monterey: California Test Bureau/McGraw-Hill, 1971. 
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specifications of the curricula evolving in the open-door colleges of 
today. " The test norms contained in the Examiner's Manual are 
derived from a sample drawn only from two-year institutions which 
are public, comprehensive, community colleges offering both transfer 
and terminal programs; all colleges are listed in the Jimior College 
Directory published by the American Associadon of Jimior Colleges. 
TTiis standardization sample (N=4,217) was further broken down into 
three separate reference groups: 

1. Students enrolled in mathematics courses listed as 
transfer credit toward the B. A. degree (N=2,003). 

2. Students enrolled in matbomatics courses labeled 
as terminal credit, A.A, degree (N=l,670). 

3. Students e^iiuU m courses labeled as remedial 

(N=544}- 

Three separate? iets of norms were derived, from the three reference 
groups listed above. This study used the norms derived from the 
remedial reference group, #3 above. The inclusion of the separate 
remedial norms, among other factors, seemed to be a test strength. 

The content of the EST: Mathematics was not built on the 
usual arithmetic, geometry, algebra subtest scheme. Rather, it uses 
a scheme of fundamental knowledge, operations and problem-solving 
as the processes to be tested, with content drawn from the three areas 
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above in each of these processes* Accordingly, the test has three 
subtests and a resultant cumulative score: 

a) Basic Information - Items (25) consist of 
terms, symbols, formulas, equivalents, 
which are deemed to be in the memory 
store as basic mathematical vocabulary* 
No calculations or derivations are re- 
quired* 

b) Computation - Items (25) consist of 
problems drawn from arithmetic, 
algebra, geometry and trigonometry, 

c) Problem Analysis - Items (15) consist 
of word problems requiring skills used 
in the first two subtests plus tiie ad- 
ditional skillb required in particular 
types of problem solving: determining 
the sufficiency of data for solving a 
problem, setting up a solution, and 
actually arriving at a correct solution* 

The Examiner's Manual also gives extensive information 
on test score characteristics* Relevant portions of this information 
as being included below so that program results delineated in 
Chapter in might be clearly interpre table* 

Rieliability evidence of the EST: Mathematics scores is 
stated in terms of internal consistency only, by the usual Kuder- 
Richardson Formula 20 (KR-20)* Also available are the standard errors 
of measurement for the raw scores, means, medians and standard 
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deviations (Table 1). Item statistics are also presented, in terms of 

item difficulty {% p) (Table 2). These statistics are derived from a 

relatively small sub-sample (N-209) of the entire original standardization 

group; the data contained in Tables 1 and 2 below are found on pages 27- 

28 of the previously cited Examiner^s Manual. 

ft 

Table 1 

KR-20's, Means, Medians, Standard Deviations 
and Standard Errors of Measurement for Raw Scores 
EST: Mathematics, Form A 

(N-209) 





No. of 












Test 


Items 


KR-20 


Mean 


Median 


S. D. 


SEmeas. 


Basic Information 


25 


.85 


15.9 


16 


5.49 


2.11 


Computation 


25 


.86 


14.5 


14 


5. 31 


1.96 


Problem Analysis 


15 


.65 


6.8 


7 


2.82 


1.66 


TOTAL EST; MATH. 


65 


.92 


37.2 


38 


12. 25 


3.36 
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Table 2 



Item Difficulties (% p) 
EST: Mathematics, Form A 
(N=209) 



MATHEMATICS 
Basic Information Computation ProMem Analysis 



Item No. 


2 


Item No. 


2 


Item No. 


E 


1 


.87 


1 


.80 


1 


.40 


2 


.70 


2 


.t>5 


2 


.53 


3 


.77 


3 


.71 


3 


.82 


4 


.56 


4 


.84 


4 


.61 


5 


.56 


5 


.72 


5 


.67 


6 


.60 


6 


.81 


6 


.52 


7 


.72 


7 


.65 


7 


.18 


8 


.60 


8 


.67 


8 


.74 


9 


.62 


9 


.91 


9 


.37 


10 


.35 


10 


.51 


10 


.55 


11 


.40 


11 


.75 


U 


.51 


12 


.69 


12 


.67 


12 


.25 


13 


.34 


13 


.90 


13 


.24 


14 


.74 


14 


.59 


14 


.21 


15 


.49 


IS 


.76 


IS 


.18 


16 


.72 


16 


.61 






17 


.51 


17 


.18 






18 


.57 


18 


.42 






19 


.71 


19 


.33 






20 


.66 


20 


.46 






21 


.70 


21 


.56 






22 


.79 


22 


.43 






23 


.57 


23 


.34 






24 


.65 


24 


.21 






25 


.66 


25 


.06 
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The accurate interpretation of results in Chapter III might 
well be aided by information on two other aspects of the EST: Mathematics, 
the subtest intercorrelations and the percent of students in the standard- 
ization sample reference group #3 (norm group) who attempted all items, 
by level of performance This information is contained in Tables 3 and 
4 below and is cited in the Examiner* s Manual on pages 30-31. 

Table 3 

Subtest Intercorrelation Coefficients 
EST: Mathematics, Form A 
(N as indicated in each cell) 



Test 
N 


Basic 
Inf. 


Comp. 


Prob. An. 


Maili. Total 


Basic Information 


1.00 


.74 


.58 


.92 


N 


5167 


5149 


5142 


5142 


Computation 




1.00 


.58 


.91 


N 




5156 


5149 


5142 


PiTxblem Analysis 






1.00 


.76 


N 






5149 


5142 


Math. TOTAL 








1.00 


N 








5142 
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Table 4 

Per Cent of Students in Reference Group #3 Attempting 
All Items, By Level of Performance 
EST: Mathematics, Form A 
(N as indicated) 



Per Cent of Students Attempting 

Reference All Items, By Fifths Total 

Test Group 1st 2nd 3rd 4th 5th Group 

Mathematics 

Basic Information 3 98 98 97 95 86 94 

Computation 3 33 25 27 14 22 23 

Problem Analj'sis 3 38 36 39 37 49 40 

TOTAL 3 ^ 35 35 43 43 40 39 



The Differential Aptitude Test: Verbal Reasoning and Numerical 
AbUity subtests (Psychological Corp. ) were also administered to all Fall 
and Spring LINK students in a ore- and posttest format, primarily to obtain 
an estimate of growth, if any, on a traditional "scholastic aptitude*' measure* 
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However, the DAT; Numerical Ability (DAT: NA) scores might also be 
considered as a second measurement of mathematics achievement. 
More specifically, the 40 items on the DAT: NA assess competency in 
the four basic arithmetic operations, as well as such procedures as 
decimals, fractions, and percentages. There is no algebra, geometry, 
or trigonometry on the test. 

The research design intended to assess differential 
growth, if any, between the three Fall LINK mathematics groups 
(MTH 08, MTH 05, MTH 00) and between the two Spring LINK mathe- 
matics groups (MTH 08, MTH 05) seemed even stronger with the 
addition of a second, different, mathematics achievement measure. 
Secondarily, the functioning of the two mathematics achievement 
instruments (EST: Mathematics and DAT: NA) in a student population 
such as LINK seemed to be potentially useful information for future 
evaluations of remedial mathematics programs. 

Scholastic Aptitude. The Verbal Reasoning and Numerical Ability 
subtests of the DAT (Psychological Corp. ) were administered to both 
Fall and Spring LINK groups as previously mentioned. The combined 
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score on the two subtests (DAT: VR + NA) yields a traditional measure 
of "scholastic aptitude"- Fc^^ L was used as the pretest (Fall and 
Spring) and Form M as the posttest, also for both semesters. The 
revised Forms S and T were not yet available from the publisher in 
September 1973, (Although the standardization sample for Forms L 
and M dates to 1962, most test items date to 1947.) 

The Fourth Edition Manual for the DAT ^ states that 
'Torms L and M contain tests which are equivalent in content and 
significance, though raw scores differ so"*^ewhat from one form to 
the other" (p. 15). The data analyses used with the DAT have ob- 
viated technical difficulties which might arise due to this non- 
equivalence. Analyses of covariance and product-moment cor- 
relations have been used; gain scores and their associated significance 
tests have not. 

Unlike the recently developed EST: Mathematics, the 
DAT and its subtests are the subjects of a large body of published 
literature. For this reason, further descriptions of the instrument 
are probably not required in this section of the evaluation report. 



Bennett, G.K. Set shore, H. G. , Wesman, A. G. , 
Differential Aptitude Tests, Fourth Edition Manual. New York: Psychological 
Corp., 1966. 
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Interests. The Kuder DD: Occupational Interest Survey (Science Research 
Associates) was used to assess vocational and personal interests for both 
Fall and Spring LINK groups. The instrument was primarily selected as 
a guidance and counseling adjunct, as stated in the original grant proposal. 
However, through intended use in a pre- and posttest format some in- 
dications of personal change were anticipated. 

The first administration of the Kuder DD uncovered some 
problems concerning the validity of this instrument for students such as 
those in Project LINK. A substantial number of protocols were returned 
with an imacceptable or questionable "V score". 

The planned pre- and posttest format was therefore dis- 
continued and the instnmient was administered only once to each LINK 
group. From this data, extensive cross -tabulations with both the Nelson- 
Denny Heading Test and the composite DAT: VR + NA score were performed. 
A report of these descriptive findings is included in the next chapter. 

Procedural Deviations from Original Plan. In addition to the procedural 
modification concerning the Kuder DD just mentioned, two other difficulties 
arose, necessitating concomittant changes. 
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1) Although numerous students received a grade of R (Repeat) 
in various courses, no student received a grade of R in every course. Hence 
no student was willing to repeat Project LINK for a second semester. Such 
repetition for half of the students who did not reach standards in the Fall 
LINK group was originally postulated in the section entitled "Program 
Duration". A comparison was then to be made between LINK repeaters and 
non-successful Fall LINK students who repeated their remedial work in 

the regular college remedial format. This compariscm was not possible for 
the reason just stated. 

2) Since students who select themselves for participation 
in LINK presiunably differ in material ways from students who prefer the 
Non-LINK regular remedial program, three subsamples of students were to 
be Involved in the project evaluation. These three subsamplee were to be: 
a) LINK students; b) Non-LINK students who did not wish to participate in 
LINK; and c) Non-LINK students who wished to participate in LINK but who 
could not be accomodated. 

liio project evaluation includes course registration, 
attrition and grade data for groups a) and b). However, all students who 
wished to participate in LINK were accomodated; hence the comparison group 
c) did not exist. Moreover, Non-LINK studeti&s in the comparison group b) 
could not be scheduled f ^r the same testing program as LINK students. 
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Comparative evaluative data was therefore, of necessity, restricted to 
attrition data, and course registration and grades. (Substantial difficulty 
was also encountered in persuading LINK students of the importance of 
the testing program. ) 

There were no other procedural modifications or changes 
necessary. All other stipulated procedures associated with a) selection 
of student and staff participants, b) constant and differential features of 
the LINK and Non-LINK conditions, and c) design for assessing the 
effectiveness of the differential features were unaltered. 
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CHAPTER III 



RESULTS 

Attrition and course enrollment information through-out 
the year were collected for both Fall and Spring LINK groups. This 
information was also collected for the comparison group of 90 students 
who, on the basis of Jime 1973 placement testing, were also eligible 
for LINK on the basis of remedial placements in reading, writing, and 
mathematics. 

The data from the LINK testing program were analyzed 
by computation of means and standard deviations for scores on all 
measures used in the study. Additionally, product-moment correlation 
coefficients were computed between all measures. 

There was a problem with missing data, especially on 
the posttest measures. Accordingly, analyses of covariance with the 
pretest scores as the covariate were run on the intact data for ail 
variables. The resultant unadjusted means and standard deviations 
for both pre- and posttest measures were then compared with the pre- 
and posttest score means and standard deviations obtained from students 
not taking both p re- and posttest measures. 
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The data from the LINK testing program were analyzed by 
numerous analyses of covariance, with a separate statistical test for 
treatment-group interaction. All data were analyzed separately by sex. 
Additionally, all mathematics measures were analyzed separately by 
the particular mathematics course enrolled in - MTH 08, MTH 05 
MTH 00. Data on all variables were also analyzed separately by cur- 
riculum, Pre-Nursing vs. Liberal Arts. Data for the Fall semester on 
all variables were also analyzed separately for the tv o blocks of STIR/LINK 
vs. the remaining blocks. 

The first two sections of this chapter contain the com- 
parative information on attrition and course enrollment. The next three 
sections contain results pertaining to the writing, reading, and mathematics 
components of the LINK program. The next two sections ocmtain results 
obtained from the scholastic aptitude and interest measures used in the 
study. The last section contains information obtained from LINK faculty. 

Attrition 

In a college as large as ours, attrition data is obtained by 
a comparison of computer registration tapes in successive semesters. 
All institutional data is retrieved in this manner. The question of 
attrition in smaller specialized programs is also answered via the 
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same procedure. However, in the case of experimental programs where 
attrition information is requested before the next semester begins, as 
herein, or where a more specific end-of-semester vs. beginning-of- 
semester retention percentage is desired, also as herein, a mod- 
ification of the usual procedure is necessary. 

The procedure used to compute an end-of-semester 
vs. beginning-of-semester retention percentage was the comparison 
of the registration roster with the end-of-semester computer grade 
print-out. Where the grade roster contained all grades of J or H 
(Official or Unofficial Withdrawal) or where grades were missing 
entirely, the student was counted as a program drop-out. This 
procedure was followed for the Fall LINK group and the Non-LINK 
comparison group for the Fall semester; it was also followed for the 
Spring LINK group for the Spring semester. 

Follow-up of the two ei;tering Fall groups, LINK and 
Non-LINK, was obtained through both a comparison of registration 
lists, Fall 1973 vs. Spring 1974, and a re-count at the end of the 
Spring 1974 se mester on the basis of grade print-outs. This method 
was intended to provide as on-line information as possible. 
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Table 5 contains retention information for both Fall and 
Spring LINK groups and for the Fall Non-LINK comparison group. 



Table 5 



Project LINK: Retention Summary and Comparison 
(N=123; 90; 68) 



Group 



Initial Regis t. 
Fall 1973 



End of 
Semester 
Fall 1973 



Initial Regist. 
Spring 1974 



End of 
Semester 
Spring 1974 



Fall 1973 LINK 
% 



123 



97 
.79 



95 
.77 



89 
.72 



Fall 1973 Non-LINK 
% 



90 



72 
.80 



59 
.65 



59 
.65 



Spring 1974 LINK 
% 



68 



57 
«8S 



First-semester retention percentages for Project LINK, 79% 
in the Fall group and 83% in the Spring group, are not significantly higher 
than the Non-LINK comparison group figure of 80%. The first-semester 
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retention percentages for Project LINK are also similar to the in- 
stitutional percentages obtained via the registration tape comparison 
method described on the prior page. The return-rate after the 
first-semester is currently approximately 75% for all students. 
Moreover, the first-semester retunrrate for entering students 
with high school averages below 70 does not differ significantly 
*from this 75% figure. 

There was some tendency towards a. sex-differentiated 
LINK first-semester retention percentage in favor of females. For 
the Fall LINK group, 82% of the females and 74% of the males were still 
enrolled at the end of the semester. The same tendency was evident 
in the Spring LINK group, where 87% of the females and 79% of the 
males were still enrolled by semester's end. This tendency in favor 
of female persisters was still in evidence when the Fall 1973 LINK 
group was followed to the end of their second semester: 77% of the 
females and 65% of the males remained. 

As Table 5 indicates, the retention rate after two 
semesters was slightly higher for Fall LINK students than for the 
Non-LINK comparison group, 72% vs. 65%. This finding raises the 
question of possible differential long-term retention in favor of a 
special program, even when no first-semester or program -duration 
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differences are discernible. (A STIR follow-up addiessed to this question 
is currently underway. ) 

The original STIR faculty, which persisted as a unit during 
the Fall 1973 semester in LINK, surfaced some feelings about possible 
differential retention in their 2 Fall STIR/LINK blocks. There was i\o 
evidence for any differential retention, in either direction. 

Course Enrollment 

All 123 Fall LINK students were enrolled in RDL 02 and 
ENG 01 during the Fall semester; 75 (or 61%) of the 123 students were 
enrolled in a remedial^ mathematics course. By comparison, only 47 
of flie 90 students in the Fall Non-LINK comparison group (or 52%) were 
enrolled in RDL 02; 48 of the same 90 students (or 53%) were enrolled 
in ENG 01; and 41 of the same group of 90 students (or 46%) were en- 
rolled in a remedial mathematics course. 

Again, as with Project STIR, students who were unwilling 
or imable to commit themselves to a block-schedule of at least three 
courses (RDL 02, ENG 01, HLT 91) or, more usually, four courses 
(RDL 02, ENG 01, HLT 91, and MTH 05 or 08), could not enroll in 
Project LINK. The Fall Non-LINK comparison group doubtless included 
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many students who could not so commit themselves. Remedial course 
enrollment figures for this Non-LINK comparison group are probably 
affected both by flie time constrainsts the students bring to the reg- 
istration procedure and by the number of courses they are willing to 
taJce at one time. 

Writing 

As mentioned previously, the writing samples obtained in 
regular ENG 01 class sessions were scored on an uncurved scale from 
1 - 9. The overall pretest mean for the Fall LINK group was foxmd to 
be 3. 9, with a standard deviation of L 7. 97 of the 123 LINK students 
submitted writing sample pretests. The overall posttest mean for the 
Fall LINK group was found to be 5.0, with a standard deviation of 2.1. 
However, only 76 of the 123 students submitted writing sample posttests. 
Therefore, the increase from pre- to post- in the Fall group might 
well be attributed to student self-selection on the posttest - with only 
the better student willing to take the posttest. 

The problem just described was to be repeated on all 
measures, for both Fall and Spring LINK groups. There was a repetition 
of a relatively small pre- to post- increase, coupled with a striking 
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increase in posttest missing data. (Mathematics instruments, especially, 
showed this trend most strikingly. ) Gains could not comfDrtably be at- 
tributed to the program. 

To avoid endless repetition of this problem, it will not be 
re -illustrated under each of the following sections. To avoid possible 
misinterpretations of the results, analyses of covariance procedures were 
used on "intact" pre- and post- scores, those cases where both scores 
were available for a student. Various subsamples of LINK students, as 
mentioned, were contrasted in these analyses. 

ANCOVA Results. Table 6 presents results for the various writing sample 
analyses of covariance. In all cases the pretest was the covariate. 

Table 6 



ANCOVA Results: Writing Samples, Fall and Spring LINK 

(N = 123; 68) 



Analysis 


df 


F 


Fall LINK 






Males X Females 


1, 63 


1.54 


Pre-Nursing (2 blocks) x Remainder 


1,63 


12.78** 


MTH 08 X MTH 15 x MTH 00 


2, 62 


i,23* 


Spring LINK 






Males x Females 


1,37 


0.46 


MTH 08 X MTH 05 


1,32 


1.12 



p T^f^ * ♦ Significant at p Z. 001 
£^ ♦Significaiit at p<l. 05 40 
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The Fall F value of 12. 78 cited in Table 6 represented a 
significant difference in writing scores when the two Pre-Nursing blocks 
were contrasted with the remainder of LINK; tiie Pre-Nursing students 
obtained signiflcpntly lower writing sample posttest scores. Since all 
Pre-Nursing students (and only they) took MTH 08, a more detailed 
3-group analysis was run: MTH 08 x MTH 05 x MTH 00. A signiJicant 
F value of 4.23 was obtained, with MTH 08 students, again, performing 
less well on the posttest than either MTH 05 or MTH 00 students. 

The significantly lower writing sample posttest results 
for the two Fall Pre-Nursing blocks were not evidenced again in the 
Spring, However, in the Spring there was only one block of Pr^ -Nursing 
(MTH 08) students. Litact pairs of scores were available for only 6 of 
the Pre->hir8in£ studenis. 

Ordinal Pr e- and Post- Results. In an effort to assess ttie pre- and post- 
results more closely, the two protocols were examined for each of the 
students. Fall rnd Spring, witii an intact pair of scores available. The 
results are presented in Table 7. 

The results presented in Table 7 demonstrate that on occasion 
(23%, 10%) a time-blinded pretest writing sample may be scored higher 
than a time-blinded posttest writing sample when botn samples are scored 
by the same instructor at tiie same time. These results would seem to 
indicate a p>jssible ' uneveness" in student writing performance, assuming 
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instructor rating is not a confounding variable. 



Table 7 



Ordinal Results: Writing Samples, Fall and Sprin'? LINK 

123; 68) 



Group 



Fall LINK 

Pretest higher than Posttest 
Pretest and Posttest same 
Posttest higher than Pretest 
Total 



Frequency 



Percent 



15 

8 

43 



66' 



.23 
.12 
.65 

100% 



Spring LINK 

Pretest higher than Posttest 
Pretest and Posttest same 
Posttest higher tiian Pretest 
Total 



4 
7 

29 
40* 



.10 
.18 
.72 

100% 



*Note. - Fall: 66 of 123 students, or 54%, had intact pairs of scores. 
Spring: 40 of 68 students, or 59%, had intact pairs of scores. 
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Correlational Results, The obtained product-moment correlation coefficients 
between writing sample pretests and posttests were moderate for both sem- 
esters, .40 for the Fall group and .37 for the Spring group. Possibly the 
somewhat attenuated range of writing sample scores, in addition to factors 
discussed in the preceding section, served to depress the coefficients. 

Waiting; Summary. There seemed to be littie evidence to substantiate a 
conclusion of significant improvement in student writing competency. 
Rather, there was some ordinal evidence for student '*uneveness" in 
writing performance. Differentially, the Fall Pre-Nursing LINK students 
in ENG 01 evidenced signlficantiy poorer end-of-semester writing per- 
formance than did students in the remaining Liberal Arts blocks. 

Reading 

As mentioned previously, the reading competency com- 
ponent of LINK was described through the use of both the Nelson-Denny 
Reading Test (N-D) in a pre- and post- format and the Departmental 
Final Mastery Test (DFMT) as a second outcome measure. Table 8 
presents descriptive statistics, Table 9 presents various product- 
moment correlation coefficients between the cited measures, and 
Table 10 presents the results of the various ANCOVA analy&.:>s. 
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Table 8 



Descriptive Statistics, Nelson-Denny Reading Test: Fall and Spring LINK 

(N = 46, 77; 29, 39) 



Males Females 

Group Mean SD N Mean SD N 

Fall LINK 

N-D Pretest, Form A 42. 1 11. 1 45 41. 8 12. 2 74 

N-D Posttest, Form B 53.2 12.5 33 51,1 14.8 59 



Spring LINK 

N D Pretest, Form A 42.9 12.1 24 37.7 7.0 27 

N-D Posttest, Form B o4.0 14.8 19 47.5 12.4 24 



The raw scores cited in Table 8 seem to Indicate, for those 
students tested, ^^iaivalence between all groups. Fall and Spring, except 
for the Spiing females who scored somewhat lower at both testings. The 
overall group means for both sexes pooled show a grade-equivalent score 
increase from 9.2 to 10.4 (Fall) and 9.0 to 10.2 (Spring). Ag-ain, this 
fairly uniform grade -equivalent increase of approximately one year in 
an essentially 4-month semester is difficult to interpret, given the 
lessened number of students appearing for the posttest However, in 
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spite of possible student self-selection on the posttest, the obtained year 
score increase in roughly four months of elapsed Instructional time would 
probably tend to substantiate a conclusion of programmatic adequacy, 
where reading skills are concerned. 



Table 9 



Product-Moment Correlation Coefficients, 
Reading Measures: Fall and Spring 
LINK 
(N=variable) 



Males Females 
N-D DFMT N-D DFMT 
Group Post- Post- Post- Post- 
Fall LINK ^ 

N-D Pretest, Form A .59** .34 .65 .45 

N-D Posttest, Form B .42** .45** 



Spring LINK 

N-D Pretest, Form A .61 .45 .82 .65 

N-D Posttest, Form B .55** .70** 



♦♦Significantly different from zero at pZ..01 
♦Significantly different from zero atp ^.05 
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From data contained iu Table 9, reading performance pre- 
U) post- as measured by the standardized Nelson-Denny Reading Test 
seems to be fairly consistent, wltii the obtained pre- to post- coefficients 
viniform y high (.59 to .82). 



the DFMT are somewhat lower (.34 to .65). This would seem to indicate 
that although reading skills are associated with the skills in the Final 
Mastery Test, the latter instrument is probably somewhat wider ranging 
in content. Similarly, the relationship between the two outcome measures 
varies Homewhat, with coefficients from .42 to .78. 



The obtained coefficients between the N-D pretest and 



Table 10 



ANCOVA Results, Reading Measures: 
Fall and Spring LINK* 
(N = 123; 68) 



Analysis df 

Fall LINK 



Males X Females 1, 88 

Pre-Nursing (2 blocks) x Remainder 1, 88 
MTH 08 X MTH 05 x MTH 00 2, 87 



2.26 
0.27 
3.06 



Spring LINK 
Males X Females 
MTH 08 X MTH 05 



1, 40 
1,34 



0.67 
0.21 



* No analyses resulted in a statistically significant F ratio. 
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In all the ANCOVA analyses, the Nelson-Denny Pretest, 
Form A, scores were the covariate and the Nelson-Denny Posttest, 
Form B, scores were the outcome variable under consideration. 

Beading Summary. Although technically somewhat difficxilt to interpret, 
LINK students evidenced gains on the standardized Nelson-Denny Reading 
Test. Whether this obtained gain was substantially greater than that 
evidenced by a Non-LINK comparison group could not be ascertained; 
Form B scores are not at this time routinely recorded where they can 
be computer retrieved. (Form A scores are recorded on computer 
tape for all students as a reading placement score. To retrieve Form B 
scores for the Non-LINK comparison group, rosters from all RDL 
instructors at the college would have been necessary. ) 

Reading performance and/or its measurement seems to 
be fairly consistent from beginning to end of semester, particularly 
where group standing, as measured by the correlation coefficient, is 
concerned. The various LINK sub-sample ANCOVA analyses delineated 
no significant differential results by curriculimi group or sex. 
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Mathematics 



As described previously, there were two Pre-Nursing LINK 
blocks In the Fall and one such block during Spring semester* The Pre- 
Nursing students, in all cases, were enrolled in MTH 06. The students 
in the Liberal Arts blocks. Fall and Spring, usually took MTH 05, hat 
occasionally no mathematics, designated MTH 00. During the Fall 
s-^mester the MTH 00 group was given the Educational Skills Test: 
Mathematics (EST: Math) by the counselors. (This was not possible 
during the Spring semester. ) MTH 00, therefore, functioned as a 
comparison group during the Fall semester for mathematics program 
evaluation purposes. 

Table 11 contains the descriptive statistics obtained from 
both the EST: Math and its subtests and the Differential Aptitude Test: 
Numerical Ability subtest (DAT:NA). Both instruments were administered 
in a pre- and post- format. Table 12 presents DAT: NA percentile 
equivalents; Table 13 presents the various product-moment correlation 
coefficients between the measures; the results of the various ANCOVA 
analysed are presented in Table 13 and Table 14. 
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Table 11 



Raw Score Means, Mathematics Measures: 
Fall and Spring LINK 
(N = 46, 77; 29, 39) 



Pretest Posttest 



Test 


Males 


(N) 


Fkimales 


(N) 


Males 


(N) 


Females 


(N) 


Fail LINK 


















DAT: NA (Forms L and M)'* 


14.5 


(32) 


12.5 


(63) 


16.0 


(24) 


16.4 


(49) 


EST: Basic Information 


7.8 


(24) 


7.0 


(50) 


9.9 


as) 


8.3 


(29) 


Computation 


6.6 


(24) 


7.2 


(50) 


8.8 


m 


8.0 


(29) 


Problem Analysis 


3.2 


(23) 


3.0 


(48) 


4.0 


m 


3.3 


(22) 


Total 


17.4 


(24) 


16.6 


(51) 


22.2 




18.8 


(29) 



Spring LINK 



DAT: NA (Forms L and M) 


13.7 


(22) 


12.3 


(35) 


14.7 




14.3 


(28) 


EST: Basic Information 


e.8 


as) 


6.0 


(31) 


10.8 


ai) 


9.0 


(24) 


Computation 


5.2 




6.1 


(31) 


7.6 


(U) 


8.1 


(24) 


Problem Analysis 


2.9 


(17) 


2.6 


(27) 


3.6 


(11) 


2.6 


(21) 


Total 


14.8 


(18) 


14.4 


(31) 


22.1 


ai) 


19.4 


(24) 



* Note - Raw scores on DAT: Forms L and M are not equivalent. 
No significant differences between the sexes. 
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When the DAT: NA raw score group means presented in 
Table 11 were converted into percentiles for comparative purposes, the 
following equivalencies using published 12th grade norms were obtained: 



Table 12 



Percentile Equivalents, DAT: NA: 
Fall and Spring LINK 
(N = 46, 77; 29, 39) 



Pretest (%ile) Posttest (%ile> 
Males Females Males Females 

FaU LINK 

DAT:NA .12 .13 .20 .22 



Spring LINK 

DAT:NA .12 .12 .17 ,17 



When the EST: Mathematics total score group means presented 
in Table 11 were converted into percentile equivalencies usiiig the published 
reference group #3 (remedial) norms, the pre- to post- increase was found 
to be negligible. That is, the total score pretest group means for both males 
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and females, Fall and Spring, were all equivalent to an individual score 
at the 5 %lle. The obtained posttest total score group means, again 
for both males and females. Fall and Spring, were all equivalent to an 
individual score at the 6 %ile. In all cases, the group raw score pre- 
to post- increases represented an increase of 1% in placement using 
the standardized remedial norms. 

By definition of the test domain, the DAT: Niunerical 
Ability Subtest scores should be closely related in a predictive format 
to the EST: Computation subtest scores. Reference to Table 13 indicates 
that for the Fall LINK group this relationship was evident. The ob- 
tained Fall correlation coefficients between DAT: NA pretest scores 
and EST: Computation posttest scores was .40 (Males) and .63 (Females). 

However, the predictive relationship was not evident 
during the ^ring semester, witii obtained coefficients of .19 (Males) 
and -.07 (Females). The various cell frequencies in Table 13 for the 
Spring semester were quite a bit smaller tiian for the Fall semester, 
but the lack of coefficient stability is still somewhat disquieting. 

Similarly, the Spring coefficients obtained for females 
on the DAT: NA pretest with the 3 EST subtest postte and with the 
total EST posttest score are disquieting, given that the DAT: NA is 
defined as a numerical ability /aptitude test. 
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The pre- to post- stability of the subtests can be extracted 
from Table 13. The coefficients ranged from -.12 (Problem Analysis) 
to .73 (Basic Information). 

The correlational anomalies encountered with these two 
instruments might be viewed, in part, as an extension of the difficulty 
with the EST evident from the descriptive statistics in Table 11. That 
is, the mean gains over the 4 month instructional period on the EST 
were negligible; often they did not exceed the errors of measurement 
for the EST presented on page 21 of this report. 

The results presented for both the DAT: NA and the 
EST suggest that growth, if any, in mathematics competency in LINK 
students occurs in the simple computational domain measured by the 
DAT: NA, not on the more sophisticated level of the EST. However, 
the issue of appropriateness of the EST for a truly remedial population 
seems to deserve more extensive investigation and replication. 
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ANCQVA Results. The ANCOVA results presented in Tables 14 and 15 
were obtained from analyses which used either the DAT: NA pre- and 
post- scores or the EST: Mathematics Total pre- and post- scores. 
In both cases the respective pre-test scores were the covariate. 
Also, as in all ANCOVA analyses in this report, a separate F-test 
for homogeneity of the regression coefficient was performed prior 
to the computation of the usual F ratio. Except where specifically 
noted, this homogeneity of regression F-test always yielded non- 
significant results, indicating an absence of significant treatment- 
group-interaction effects. 

Table 14 

ANCOVA Results, DAT: NA Scores: 
Fall and Spring LINK 
(N =123; 68) 



Analysis df p 

Fall LINK: DAT:NA 

Males X Females 1,63 0.30 

Pre-Nursing (2 blocks) x Remainder 1, 63 4. 01* 

MTH 08 X MTH 05 x MTH 00 2, 62 4. 42* 



Spring LINK: DAT:NA 

Males X Females 1,39 0.01 

MTH 08 X MTH 05 1,35 0.15 



♦Significant at p^.05 
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The Fall F value of 4, 01 in Table 14 represented a sign- 
ificant difference in DAT: NA adjusted posttest scores when the two 
Pre-NursiL^ C ':s wiere contrasted with the remainder of LINK; 
the Pre-Nursing students obrained sigaificantly higher DAT; NA 
posttest scores. Since all Pre-Nursing students (and only they) took 
MTH 08, a m- ^ ailed 3 -group analysir was performed; MTH 08 x 
MTH 05 X MTH 00. A significant 7 value of 4.42 was obtained, with 
MTH 05 performing significantly less well than either MTH 08 or 
MTH 00 . 

The significantly higher DAT:NA posttest results for 
the two Fall Pre-Nursing blocks were not evidenced again in the 
Spring. However, in the Spring there was only one block of Pre- 
Nurslng (MTH 08) students and intact pairs of DAT: NA scores were 
available only for 9 of these students. 

The Fall finding of significantly better end of semester 
mathematics performance by Pre-NursJng students (MTH 08 x MTH 05) 
as measured by the DAT:NA probably reflects tlrz almost exact con- 
gruence between the test and the MTH 08 curriculum. However, the 
subsequent result when the MTH 08 x MTH 05 x MTH 00 analysis was 
performed is somewhat disquieting. 
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Table 15 



ANCOVA Results, EST: Mathematics Total Scores: 
Fall and Spring LINK* 
(N = 123; 68) 



Analysis 


df 


F 


Fall LINK: E ST Total 






Male s X Females 


1,40 


0.80 


Pre-Nursiag x Remainder 


1,40 


0.23 


MTH 08 X MTH 05 x MTH 00 


2,39 


0.14 


Spring LINK: EST Total 






Males X Females 


1,31 


0.40 


MTH 08 X MTH 05 


1,31 


2.60 



* No analyses resulted in a statistically significant F ratio> 



When ANCOVA results for the Computation subtest of the EST 
were examined, there were no significant differences in favor of Pre-Nursing 
(MTH 08) blocks for the Fall, as the DATrNA results would have suggested. 
Again, there was a lack of consistency in results between the tvo mathematics 
measures* 



Mathematics: Summary > On the basis oi the EST, there was no eviderce 
to support a co" elusion of significant improvement in mathematics competency 
among LINK students. In many cases, gains did not exceed the standard 
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error of measurement. Moreover, the pre- to post- correlation coefficients 
for s» ores on some of the subtests of this instrument evidenced or pronoxmced 
lack of stability over the 4 month instructional period. However, adequacy of 
the instximient has not been full: monstrated. 

On tiie basis of the DAT:NA scores, tiiere was some evidence 
for differential posttest computational performance in favor of MTH 08 
Pre-Nursing students. Somewhat peciiliarly, when MTH 00 performance 
was added to the analysis, both MTH 08 and MTH 00 students evidenced a 
greater gain in computational proficiency tiian did MTH 05 students. 

Scholastic Aptitude 

The Differential Aptitude Test: Verbal Reasoning and Numerical 
Ability (DAT: VR + NA) composite score yields a traditional measure of 
scholastic aptitude. A basic research question underlying the use cf this 
instrument was whether or not time or the instructional process could 
indeed effect an obtained score increase on what has been traditionally 
regarded as a more "fixed" attribute than achievement in a specific 
academic subject. Secondarily, the individual results on the I>AT were made 
available to counselors on request for guidance and counseling purposes. 
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Percentile equivalents for group means on the composite 
DAT: VR + NA scores are presented in Table 16. As with the NA mean 
percentile equivalents on page 47 of this report, published 12th grade 
norms were used. 

Table 16 



Percentile Equivalent Scores, DAT: VR + NA: 
Fall and Spring LINK 
(N = 46, 77; 29, 39) 



Test 



Fall LINK 
DAT: VR+ NA 



Pretest (%Ue) 
Males Females 



.14 



.13 



Posttest (%ile) 
Males Females 



.22 



.19 



Spring LINK 
DAT: VR + NA 



.13 



.14 



.14 



.16 



From Table 16, scores on the composite DAT: VR + NA showed 
an increase for the Fall LINK group, but not for the Spring group. The obtained 
Fall increase pre- to post- led to the differential ANCOVA analyses presented 
in lable 17. In all cases, the DAT: VR + NA score was the covariate. 
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Table 17 



ANCOVA Results, DAT: VR NA Scores, 
Fall and Spring LINK 
(N - 123; 68) 



Analysis df f 

Fall LINK 

Males X Females 1, 65 11. 14 ** 

Pre-Nursing x Remainder 1, 65 2. 81 

MTH 08 X MTH 05 x MTH 00 2, 64 2. 91 



Spring LINK 

Males X Females 1,39 0.03 

MTH 08 X MTH 05 1,35 0.74 



**Signif leant at p < . 01 

Somewhat surprisingly, there were differential gains in the 
composite VR + NA score when the data were ANCOVA analyzed by sex. 
Fall males evidenced significantly higher end of semester perlcrmance on 
the measure of scholr^tic aptitude. When additional Fall analyses were 
performed by specific subtest (VR and NA separately), the differential gain 
was evidenced on the VR subtest by the males. 
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Scholastic Aptitude: Summary. Scores on a traditional measure of 
s^.iOlastic aptitude showed some increase for the Fall LINK group. 
Somewhat unexpectedly, differential increases in favor of males 
were obtained, with the differential gain attributable to Verbal Reason- 
ing subtest score gains by the males. The Fal) results were not 
found again for the Spring group; here, pre- to post- scores showed 
little change. The various analyses performed seem to suggest 
that indicia of scholastic aptitude might not be as "fixed" as has 
been traditionally supposed, although increases noted for the Fall 
group might well be interpreted as the usual regression toward the 
mean. Further research in this area, using a large subject pool, 
would be most informative. 

Interests 

Originally, the Kuder DD was to be administered to all 
LINK students in a pre- and post- format to assess changes in Inventoried 
interests. The individual results were also to be made available to 
coimselors for guidance and counseling purposes. The initial admin- 
istration of the Kuder DD turned up some imexpected instrument- 
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related problems with our students; accordingly, the original pre- and 
post- format was modified to include only one test administration per 
LINK group. 

The Kuder DD V score proved to be somewhat problematic. 
The Kuder DD protocols are returned by Science Rese^/ch Associates 
without an occupational print-out if the V score is less than 40 and/or 
ifH^i: :dpational ranked values are less than .30. However, the 
Kuder DD General Manual (p. 6) cites a V score below 45 as suspect. 
Fully 19% of the 84 Fall Kuder DD protocols listed V scores between 
40 and 44, the area of suspect validity; Unfortunately, the SRA 
computer does list occupational print-outs for scores in this range. 
The General Manual ( p. 22) additionally cites a V score below 47 as 
psychometric ally unacceptable. 

If the less stringent criterion for acceptability, a V score 
of 45 or more is used, only 50% of the 84 Fall Kuder DD protocols were 
valid and usable. On replication with the Spring LINK group, 43% of the 
33 protocols wore again invalid. 

For even the valid protocols, those with V scores of 45 
or more, the occupations most frequently suggested on the basis of 
interests seemed oddly at variance with the students academic place- 
ment mto remedir ' courses. Example: of 30 valid Fall female protocols 
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the most frequently suggested occupations were: Pediatrician (28), 
Psychiatrist (24), Physician (21), Optometrist (20) and Dentist (19). 
The Kuder Manual stresses the need for protocol interpretation in 
light of academic achievement and ability; never-the-less, computer 
print-outs listing the occupations just cited seem inadvisable and 
inappropriate for students enrolled in remedial courses. 

The entire question of exactly why there were so 
many protocols with low V scores is being analyzed; the analyses 
are being done by reading score and DAT: Vxi and DAT: VR + NA 
scores. 

Faculty Input 

As previously mentioned, faculty workshops were held 
during both semesters. Although attendance was somewhat less than 
optimal, a variety of programmatic advantages and problems were 
surfaced. 

Major advantages cited centered on the following: 

1. Cross-discipline faculty facilitation as an 
outgrowth of the weekly faculty conferences, 
held by each LINK block individually. Teaching 
methods, common curricular areas, and 
problems served as foci of these meetings. 
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2. Better understanding of the particular strengths 
and problems of individual students, also as an 
outgrowth of the weekly, faculty conferences. 

3. Less chance of a students '^getting lost**. This 

■ advantage was cited primarily by the counselors. 
From the weekly meetings, the coimselor knew 
which student had not attended classes; There- 
fore, the counselor intensified efforts to contact 
the student. 



Major problems cited were primarily structural and 
centered on the following: 

1. fiidividual academic departments did not schedule 
or take into account the weekly two hour faculty 
conference. Therefore, in some LINK blocks, 
the four faculty members did not have a common, 
free time to meet. 

2. Responsibility for opening and closing sections 
at registration was somewhat ambiguous, with 
some department chairmen somewhat reluctant 
to relinquish authority to the Project Director. 

3. The Mathematics Department modularized many 
sections of MTH 05. LINK students therefore 
did not all stay with the same mathematics 
instructor for the semester. This proved to 

be fairly disruptive to the familial framework 
for faculty and students in the blocks. 

4. SPD 99 is a ncm-credit course. Students are 
sometimes quick to grasp the fact that although 
attendance is requested, non-attendance carries 
no sanctions or penalties. Hence, not all 
college drop juts are immediately recognized 
as such. 
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The recommendations and conclusions that follow from 
the results cited in this chapter are detailed separately in the next 
concluding chapter. 
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CHAPTER IV 
CONCLUSIONS AND RECOMMENDATIONS 

Achievement of Project Oblectives 

As mentioned in the original grant proposal and as restated 
on page 11 of this report, the program objectives, listed in order of es- 
timated likelihood of positive effects, were: 

1. Reduced attrition 

2. Improvement in specified dimensions of personality 

3. Improvement in basic skills 

4. Improved achievement in regular community 
college courses 

The achievement of each of the above objectives will be detailed separately. 

Attrition. First-semester retention percentages for Project LINK, 79% in 
the Fall group and 83% in the Spring group, are not significantly higher than 
either the Non-LINK comparison group figure of 80% or the institutional 
first-semester return rate o* approximately 75%. However, there was 
some evidence to support a conclusion in favor of some differential female 
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first-semester retention- 82% in the Fall group and 87% in the Spring group. 

When the Fall LINK students were followed into their second 
semester, the retention rate for LINK was slightly higher than for the 
Non-LINK comparison group, 72% vs. 65%. Again, females persisted 
at a somewhat higher rate, 77% vs. 65%. The two-semester LINK vs. 
Non-LINK differential raises the question of possible differential long- 
term retention in favor of a special program, a question which is un- 
answerable immediately. 

However, in all fairness, the retention rate exhibited by 
the pilot project, STIR, was not evident on replication and expansion of the 
program. 

Dimensions of Personality . Differential retention, LINK vs. Non-LINK, 
would offer direct evidence of increased persistence and indirect evidence 
of an increase in such constructs as achievement motivation and allied 
ego functions. No conclusion of improvement in these specified dimensions 
of personality can be c'rawn on the basis of retention figures cited. 

On a more superficial level, instrument-related validity 
problems preclude any conclusion as to changes in interests on the part of 
LINK students. 
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Basic Skills, a) There was no evidence to substantiate a conclusion of 
significant improvement in writing skills. 

b) On the basis of Nelson-Denny results, there was 
sufficient evidence to conclude that reading scores for the LINK group 
had been raised, 

c) On the basis of the Educational Skills Test: Mathematics 
there was no evidence for any improvement in mathematics competency. 
However, on the basis of the DAT:NA scores, there was evidence of 
substantial improvement in the computational skills of the Pre-Nursing 
students, 

d) Allied to the basic skills, there was a somewhat 
idiosyncratic finding of an increase in measured scholastic aptitude 
on the part of Fall male LINK students, particularly where verbal 
reasoning abilities are concerned. 

Regular Community College Courses^ This last objective must be assessed 
longitudinally. The LINK and Non-LINK groups will be follov/f>d with 
respect to: cumulative grade point average in college-level courses, 
degree credits earned; graduation or successful transfer from the 
college. 
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Plans for Project Continuatiop 



Some faculty have expressed an interest in continuing the 
project; the Office of the Dean of Academic Affairs is amenable to this. 
The History and Social Science Departments want to join such an 
enterprize; the Office of the Dean of Academic Affairs is albo amenable 
to this. As individual departmental or faculty interests so dictate, 
modified blocks will be scheduled. 

Modifications or Changes in College Program 

Various areas of change have been rather clearly delineateu 
by the project and its assessment. From the standpoint of program and 
student competency assessment, the inadequacy of standardized, norm- 
referenced instruments has been underscored. Criterion -referenced, 
objectives-based tests should probably be developed in writing and 
mathematics. Specific coirpetency or skill attainment on the part of 
the student could then be described. 

Also as a result of the program assessment, various 
technical questi ons seem to deserve further research. Primary among 
these questions are those related to the validity of the Kuder DD for 
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inner-city students and those related to the gratifying increase in measured 
scholastic aptitude among our Fall male students. 

In a much larger context, Project LINK has served to breakdown 
some of the rigid curricular boundaries between basic skill academic areas 
that are in reality quite interrelated. Interdepartmental communication 
concerning teaching methods and curriculum has improved substantially 
on tiie level of individual faculty, even if structural difficulties inherent 
in a traditional, departmental college remain. 

The college is fully aware of these structural difficxxlties. 
The Office of the Dean of Academic Affairs has sought to obviate many 
of these probler^ through a proposed ''Cluster College''. This College, 
in essence, world be an expansion of Project LINK, into a structure 
where chances of success might be enhanced. Analogously, the college 
is aware of the need for instructional development, instruction methods 
and materials especially suited to our particular student population. 

The experience with Project LINK has sensitized both 
faculty and administration to the problems and chanllenges posed by 
our remedial students. Hopefully this report has managed to convey 
some of our efforts to meet this challenge. 
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APPENDIX A 



TO: 



E.nG 01 Instructors, 



Project LINK 



FROM: 



Dr. Thea Benenson 



DATE: 



January 7, 1974 



May 8, 1974 



RE: 



Evaluation of ENG 01 Component of Project LINK 



Enclosed you will find writing samples collected from students currently in Project 
LINK, but taught by a colleague. Detailed comments or corrections on each paper 
are NOT necessary. Merely assign a numerical grade to each paper, using the 
following scale with your own gr'; ling standards. The numerical grades need NOT 
be curved in any way. 



Please return the papers, marked with a number from 1 to 9, to me. Room 409 
Gould Residence Hall at your earliest convenience. It is important that the papers 
are returned before intersession (June 1) since final data analysis is due to start 
at that time* 

At this point I want to again express my personal thanks for your time and effort. 
Should there be any questions, I can be reached at extension 654. 




1 

2 



The lowest level of writing. 

These i.umbers dre available to describe 
1 gradations between 1 and 5. 



The mean (average) level of writing. 

j These numbers are available to describe 
gradations bet\^'een 5 and 9. 



The highest level of writing. 



TFBisb 

cc: Dean Richard Donovan 
Dr. Norman Eagle 



UNIVERSITY OF CALIF 
LOS ANGELES 

JUN 2 7 1975 
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